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Abstract — This work considers the problem of quickest detec- 
tion with N distributed sensors that receive continuous sequen- 
tial observations from the environment. These sensors employ 
cumulative sum (CUSUM) strategies and communicate to a 
central fusion center by one shot schemes. One shot schemes 
are schemes in which the sensors communicate with the fusion 
center only once, after which they must signal a detection. The 
communication is clearly asynchronous and the case is considered 
in which the fusion center employs a minimal strategy, which 
means that it declares an alarm when the first communication 
takes place. It is assumed that the observations received at the 
sensors are independent and that the time points at which the 
appearance of a signal can take place are different. It is shown 
that there is no loss of performance of one shot schemes as 
compared to the centralized case in an extended Lorden min- 
max sense, since the minimum of N CUSUMs is asymptotically 
optimal as the mean time between false alarms increases without 
bound. 
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Fig. 1: One shot communication in a decentralized system of 
N sensors. 



I. Introduction 

The problem of decentralized sequential detection with data 
fusion dates back to the 1980s with the works of [1] and 
[2]. We are interested in the problem of quickest detection 
in an A^-sensor network in which the information available is 
distributed and decentralized, a problem introduced in [16]. 
We consider the situation in which the onset of a signal 
can occur at different times in the N sensors, that is the 
change points can be different for each of the N sensors. We 
assume that each sensor runs a cumulative sum (CUSUM) 
algorithm as suggested in [7], [1 1]— [14] and communicates 
with a central fusion center only when it is ready to signal 
an alarm. In other words, each sensor communicates with the 
central fusion center through a one shot scheme. We assume 
that the N sensors receive independent observations, which 
constitutes an assumption consistent with the fact that the N 
change points can be different. So far in the literature (see 
[7], [11]-[14]) it has been assumed that the change points 
are the same across sensors. In this paper we consider the 

'This research was supported in part by the U.S. National Science Foun- 
dation under Grants ANI-03-38807, CNS-06-25637 and CCF-07-28208 



case in which the central fusion center employs a minimal 
strategy, that is, it reacts when the first communication from 
the sensors takes place. We demonstrate that, in the situation 
described above, at least asymptotically, there is no loss of 
information at the fusion center by employing the minimal one 
shot scheme. That is, we demonstrate that the minimum of N 
CUSUMs is asymptotically optimal in detecting the minimum 
of the N different change points, as the mean time between 
false alarms tends to oo, with respect to an appropriately 
extended Lorden criterion [5] that incorporates the possibility 
of N different change points. As an observation model we 
consider a continuous time Brownian motion model, which is 
a good approximation to reality for measurements taken at a 
high rate. Moreover, given a high rate of observations from 
any distribution, the central limit theorem asserts that sums 
of such observations are normally distributed and therefore 
the Brownian motion model is a plausible model for such 
situations. 

The communication structure considered in this paper is 
summarized in Figure 1, in which Ti for i = I,..., TV 
denote stopping times associated with alarms at sensors Si 



i = 1, . . . , N, respectively. 

In the next section we formulate the problem and demon- 
strate asymptotic optimality (as the mean time between false 
alarms tends to oo), in an extended min-max Lorden sense, 
of the minimum of N CUSUM stopping times in the case of 
centralized detection. We then argue that this result suggests no 
loss in performance of the one shot minimal strategy employed 
by the fusion center in the case of decentralized detection. We 
finally discuss an extension of these results to the case of 
correlated sensors. 

II. The centralized problem 

We sequentially observe the processes {£^ , t > 0} for all 
i = 1, . . . , N with the following dynamics: 



(1) 



d ^(i) = f dw[ l) t< Ti 

I fidt + dw^ ' t > Tj 



where /i > is known 2 , {w\ % '} are independent standard 
Brownian motions, and the t^'s are unknown constants. 

An appropriate measurable space is Q = C[0, oo) x 
C[0, oo) x . . . x C[0, oo) and T = U t>0 T t , where {T t } 
is the filtration of the observations with Tt = o"{s < 



*;(e 



(1) 



^s )}• Notice that in the case of centralized de- 



tection the filtration consists of the totality of the observations 
that have been received up until the specific point in time t. 

On this space, we have the following family of probability 
measures {P Ti ,...,t n }, where P Tlt ... tTN corresponds to the 
measure generated on £1 by the processes (^ ,...,Q ) 
when the change in the iV-tuple process occurs at time point r^, 
i = 1, . . . , N. Notice that the measure Poo,...^ corresponds 
to the measure generated on Q by N independent Brownian 
motions. 

Our objective is to find a stopping rule T that balances 
the trade-off between a small detection delay subject to a 
lower bound on the mean-time between false alarms and will 
ultimately detect min{Ti, . . . , tjv} 3 . 

As a performance measure we consider 



(2) J{P(T) = 
sup essup E Tl ) 

Tl,...,Tjv 



{(T- Ti A...At n })+\T TiA ... Atn } 



where the supremum over t\ , . . . , rjv is taken over the set 
in which min{ri, . . . , rj\r} < oo. That is, we consider the 
worst detection delay over all possible realizations of paths 
of the A^-tuple of stochastic processes (Q , . . . , Q ) up to 
min{ri, . . . , tn} and then consider the worst detection delay 
over all possible A^-tuples {j\ 1 . . . , tjv} over a set in which 
at least one of them is forced to take a finite value. This is 
because T is a stopping rule meant to detect the minimum of 
the N change points and therefore if one of the N processes 
undergoes a regime change, any unit of time by which T 

2 Due to the symmetry of Brownian motion, without loss of generality, we 
can assume that fi > 0. 

3 In what follows we will use t\ A ... A r N to denote min{r! , . . . , t n }. 



delays in reacting, should be counted towards the detection 
delay. 

The criterion presented in (2) results in the corresponding 
stochastic optimization problem of the form: 



(3) 



inf^m 



subject to E 



m > 7- 



We notice that the expectation in the above constraint is 
taken under the measure Poo,...,oo- This is the measure gener- 
ated on the space Q in the case that none of the N processes 
(Ct > • • • j Ct ) changes regime. Therefore, S 00) ... )00 {T} is 
the mean time between false alarms. 

In the case of the presence of only one stochastic process 
(say {£ t }), the problem becomes one of detecting a one- 
sided change in a sequence of Brownian observations, or a 
vector of observations (£ t , . . . , Q ) with the same change 
points, whose optimal solution was found in [3] and [15]. 
The optimal solution is the continuous time version of Page's 
CUSUM stopping rule, namely the first passage time of the 
process 

dP T - 
sup 



(1) _ 



log 

o<n<t dP a 

^ 1} - i/A 



-.M) 



,(D 



T t 



,(!) 



inf u 

0<s<t 



X 1 ) 



(1) 



(4) yX' - 

(5) 4 1} 

and 

(6) 

The CUSUM stopping rule is thus 

(7) T v = mf{t>0;yl L >>v}, 

where v is chosen so that E^ {T„} = -=?f{y) 
f(v) = e v — v — 1 (see for example [4]) and 
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where 



with 



(8) 



J%\T v ) = E {T v }=^- 2 f{-v). 



The fact that the worst detection delay is the same as that 
incurred in the case in which the change point is exactly is 
a consequence of the non-negativity of the CUSUM process, 
from which it follows that the worst detection delay occurs 
when the CUSUM process at the time of the change is at 
[4]. 

We remark here that if the N change points were the same 
then the problem (3) is equivalent to observing only one 
stochastic process which is now iV-dimensional. Thus, in this 
case, the detection delay and mean time between false alarms 
are given by the formulas in the above paragraph. 

Returning to problem (3), it is easily seen that in seeking 
solutions to this problem, we can restrict our attention to 
stopping times that achieve the false alarm constraint with 
equality [8]. The optimality of the CUSUM stopping rule in 
the presence of only one observation process suggests that a 
CUSUM type of stopping rule might display similar optimality 
properties in the case of multiple observation processes. In 
particular, an intuitively appealing rule, when the detection of 



min{ri , . . . , tjv} is of interest, is T^ = T^ A . . . A TP , where 
Ti is the CUSUM stopping rale for the process {Q^;t > 0} 
for i = 1, . . . , N. That is, we use what is known as a multi- 
chart CUSUM stopping time [10], which can be written as 



(9) T h 
where 

Vt = SU P lo g . ,, 

0<Ti<t «-* OO 



inf{i>0;max{j/ t (1) ,...,j/ t (JV) }>/i}, 

^i S) l 2, • n ( Ai) 1 2 



:f, 



and the P Ti are the restrictions of the measure P T 
C[0,oo). 

It is easily seen that 



to 



Jm (Th) — -£'0,oo,...,oo 



{Th} — -E"oo,o 



{Th} 



E n 



,o ITU ■ 



This is because the worst detection delay occurs when at 
least one of the N processes does not change regime. The 
reason for this lies in the fact that the CUSUM process is 
a monotone function of ji, resulting in a longer on average 
passage time if [i = [9]. That is, the worst detection delay 
will occur when none of the other processes changes regime 
and due to the non-negativity of the CUSUM process the worst 
detection delay will occur when the remaining one processes 
is exactly at 0. 

Notice that the threshold h is used for the multi-chart 
CUSUM stopping rule (9) in order to distinguish it from v 
the threshold used for the one sided CUSUM stopping rule 
(7). 

In what follows we will demonstrate asymptotic optimality 
of (9) as 7 — > oo. In view of the discussion in the previous 
paragraph, in order to assess the optimality properties of the 
multi-chart CUSUM rule (9) we will thus need to begin by 
evaluating i?o,oo,...,oo {Th} and Poo,...,oo {Th}. 

Since the processes Q , i = 1, . . . , N, are independent it 
is possible to obtain a closed form expression through the 
formula 



(10) 



Er\ 



,oo,...,oo 



f 

Jo 



{T h } = / P ,oo,...,oo(Th > *) 



Po,oo,...M{Th > t} n . . . n {7f > t})dt 

POO 

= / P (Tl > t) [P^Tt > t)] - dt. 
Jo 



Similarly, 



(11) £«,,...,«, {T h } 



N 



[Pc^ 1 > i)] dt 



where {X£ > t} = {sup 0<s<t ys < h}. In other words, the 
evaluation of (10) and (11) is possible through the probability 



(i) 

density function of the random variable sup < s<t j/s for 
arbitrary fixed t which appears in [6]. 

In order to demonstrate asymptotic optimality of (9) we 
bound the detection delay J M of the unknown optimal 
stopping rule T* by 



> J'm'(t*) 



(12) £o,oo,...,oo { T h} 

where h is chosen so that 

(13) Pco,...,co{7U = 7 - 

It is also obvious that J M (T*) is bounded from below by 
the detection delay of the one CUSUM when there is only one 
observation process, in view of the fact that 

su Pti,...,t w essupP Tli ... jTjv |(T- ti A ... AT N ) + \J r TlA .., ATN \ 

> sup ri essup E Tl l(T- ti) + \T Ti | . 

The stopping time that minimizes 

sup r essup E Tl <(T — ti) \T Tl \ is the CUSUM stopping 
rule T„ of (7), with v chosen so as to satisfy 

(14) Pco{7U = 7- 

We will demonstrate that the difference between the upper and 
lower bounds 

(15) Eo ) oo ) ...,oo {Th} >J { m\t*) >E {T„}, 

is bounded by a constant as 7 — > 00, with h and v satisfying 
(13) and (14), respectively. 
Lemma 1: We have 



> 



-Eo,oo,...,oo {Th} — 

(16) 



log 7 + log 



Nfi 2 



l + o(l) 



as 7 — > 00, 

Proof: Please refer to the Appendix for a sketch of the proof. 
Moreover, it is easily seen from (8) that 



(17) E {T V } 



F 



log 7 + loj 



li- 



1 + 0(1) 



Thus we have the following result. 



(N) 



Theorem 1: The difference in detection delay J M of the 
unknown optimal stopping rule T* and the detection delay of 
Th of (9) with h satisfying (13) is bounded above by 

-^(logtf), 

as 7 — > 00. 

Proof: The proof follows from Lemma 1 and (17). 

The upper and lower bounds on detection delay for the 
optimal stopping rule, when fi is |, 1 and 2, in the case that 
N = 2 are shown in Figure 2. 

The consequence of Theorem 1 is the asymptotic optimality 
of (9) in the case in which all of the information becomes 
directly available through the filtration {Tt} at the fusion 
center. We notice however that this asymptotic optimality 
holds for any finite number of sensors N. 

We now discuss the implications of the above result in 
decentralized detection in the case of one shot schemes. 



The upper and lower bounds on the detection delay (DD) for the optimal stopping rule 
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Fig. 2: (Left) Case of fi = |. (Middle) Case of ^2 = 1. (Right) Case of p = 2. (Note that the differences between upper and 
lowers bounds are all bounded as 7 increases.) 



III. Decentralized detection 

Let us now suppose that each of the observation processes 
{ft } become sequentially available at its corresponding sen- 
sor Si which then devises an asynchronous communication 
scheme to the central fusion center. In particular, sensor Si 
communicates to the central fusion center only when it wants 
to signal an alarm, which is elicited according to a CUSUM 
rule 2^ of (7). Once again the observations received at the 7Y 
sensors are independent and can change dynamics at distinct 
unknown points Ti. The fusion center, whose objective is to 
detect the first time when there is a change, devises a minimal 
strategy; that is, it declares that a change has occurred at the 
first instance when one of the sensors communicates an alarm. 
The implication of Theorem 1 is that in fact this strategy is the 
best that the fusion center can devise and that there is no loss 
in performance between the case in which the fusion center 
receives the raw data {Q , ■ • ■ f t } directly and the case in 
which the communication that takes place is limited to the 
one shown in Figure 1 . To see this, the detection delay of the 
stopping rule T h = l£ 'A. . .AT^ is equal to E 0)OOy ,, >oo {T h } 
when Si is the one that first signals an alarm, £ l oo ,0 ) ...,oo{2fc} 
when S2 first signals and so on all of which are equal due 
to the assumed symmetry in the signal strength p received at 
each of the sensors Si when a change occurs. The mean time 
between false alarms for the fusion center that devises the rule 



T h = T, 



(i) 



A 



.A if) 



is thus E a 



{Th}. But Theorem 



1 asserts that this rule, namely Th, is asymptotically optimal 
as the mean time between false alarms tends to 00 in the 
centralized case for any finite N. In other words, the CUSUM 



stopping rules T^ , T, 



(1) m(a) 



<*) 



are sufficient statistics (at 



least asymptotically) for the problem of quickest detection of 
(3). 



thresholds {hi} should be chosen so that 



En. 



oc,...,oo 



{T c } - E oa> 



0,00,. ..,00 



{T c }=... = -E , oo,...,oo,o{7c } 



where T» = T h \ A... A T&. 

A further interesting extension corresponds to the case of 
correlated sensors. To demonstrate this case let us begin by 
assuming that N = 2. This case corresponds to (1), but with 

(18) eIw^w^I = pmm{s,t} Vs,i>0. 

This case becomes significantly more difficult because of 
the presence of local time in the dynamics of the process 
niax{j/| , y\ '}. Nevertheless, it is possible to derive a for- 
mula for the expected delay of Th under the measure Poo, 00 ■ 
This expression is given by 

Eoo^ {T h } = \{e h -h-l) 



2(1 - p)E J I (e^ - 1)%« - y^)ds 



(19) 



where 5 denotes the Dirac delta function and the final term 
in this expression corresponds to the collision local time of 
the processes y\ and y\ weighted by the factor (e Vt — 1). 
The difficulty in the use of expression (19) is the fact that as 
p changes, the expected value of the collision local time term, 
which is the last term in (19), also changes. Moreover, the 
expression for the first moment of Th becomes significantly 
more complicated under the measure Pq,oo- 



IV. Possible extensions 

An interesting extension corresponds to the case in which 
the signal strengths p, are different in each sensor after the 
change. That is, after the change the signal in Si is pi with 
Ml 7^ A*2 7^ • • • 7^ y-N- In this case, it is not clear what 
the optimal choice of thresholds is, but it is possible that the 
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V. Appendix 

As an illustration for general case, let us prove the result 
for N = 2. 

We begin by deriving expressions for i?o,oo {Th} and 
E 00t00 {Th} by using the results in [6]. For all h > 2, we 
have 



e h sin 3 0; sin 3 6~ 



ji 2 f—' (9i — sin 0i cos 6i) (8j — sin 8j cos 8j) cos 2 8i + cos 2 6j 
64 e sinh rj ^-^ sin 8i cos 2 0, cosh r\ 



ji 2 sinh rj cosh rj - rj ^ 0i - sin 0j cos 8i cos 2 6 t + cosh r\ 



-h ™„),6 



16 e sinh 77 cosh rj 
ji 2 (sinh 77 cosh 77 — rj) 2 

= S i (h)+S 5 (h)+S 6 (h), 



tan0„ 
tan 9 n 
tanh?7 



-<f> n <0 



0„>o 



-rj > 0. 



The idea then is show Si(h), 82(h), 84(h) and 65 (/V) 
converge to zero, and examine how 82(h) and 85(h) behave 
as h — > 00. In the following paragraphs we shall analyze 
these in the order Sg(h) — > 83(h) — > 82(h) — > S^(h) —> 
Si(h) -> Si(h). 

First notice that for large h, rj is large and close to 75- • 
Moreover, 



ji v -h 



1 - Arje-^ + o(e-^) 



3, A 



-Eo.oo {Th} 
32 y^ sin 4>i sin 

ji 2 4^ (4>i ~ sin fc cos 4>i)(0j 



sin <f>i sin 0j cos 2 <j>i cos 2 9j 

j — sin 0j cos 8j) cos 2 4>i + cos 2 6 



This can help us to compare rj with h. 
For Se(h), 

16 -2 

8e(h) = -^^T sinh rj(\ — rysinh - rycosh - rj) 

jJL 2 

= -I^ [ e ^ + (877 - 4) e 2 " + o(e")] 
ji 

= -1 [e h e^- 2h + (877 - i)e 2 ^ h + o(e-')] , 

by (20) the first term is 

e h e 4n-2h = e h ' e 2n-h^ 2 = e h ^ _ 4^-2*7 + ^-3^] 

= e h [1 - 8rje- 2r i + o(e-^)} 
= e h - 8rje h - 2 ^ + o(e^) 
= e h -8rj + o(e- r ^) 1 



sinh r\ ^-^ sin 4>i cos 2 4>i. 

s 2 <f>i + cosh 77 



- sm 0j 

32 sinh rj ^-^ sin 4>i c °s 2 4>i c °s 2 'Pi 

a 2 sinh 77 cosh rj — rj ^— ' fa — sin <pi cos fa cos 15 J "' " 

32 sinh 77 ^— v sin (f>i cos 2 4>i 

ji 2 sinh 77 cosh rj — rj -f— ' 4>i — sin 4>i cos <fii 

= S 1 (h)+S 2 (h)+S 3 (h), 



Jand the second term is 



(877 - A)e 2 ^ h = (877 - 4) [1 + o(e-'»)] 

= 8r/-4 + o(e^), 



so 



(21) S 6 (h) = — \e n -4 + o(e-i)\ , as h->oo. 



For S^(h), also note that from (8) and [6] we can write 

2 

~7z- 



F 



/>CO 

f(-h) = / P (T h >t)dt 

Jo 



(22) 

from which we obtain 
S 3 (h) = 



16 



-£ 



i>i 



sin 0i cos 2 4>i 
4>i — sin <^j cos 4>i 



Consequently, 

(28) \Si(h)\ = o(l), as /i^oo. 

Similarly, 



(29) 



|S 4 WI 



1 



o(e ), as h — > oo. 



32 



sinh 77 



yU 2 sinh 77 cosh 77—77 



£ 

i>l 



sin ^j cos 0j 



sin ©,• cos ( 



(23) 



2 

7 2 



[l + o(e-')](h+e- h -l) 

h — 1 + o(e~ 2 ) , as /i — > 



To bound 82(h) and 6*5 (ft) we need the following, 
Result 1: Suppose < 73 < 1. Then, for all positive solutions 

{ a i}i>i to the equation tanx = px (tana; = — px, resp.), we 

have 



(24) 



lim > 



I sin Oii J cos 2 on 1 



p^o+ ■" — ' on — sin Oj cos ai 

Z>1 



This suggests that, asymptotically, as h — > 00, 

I sin 3 </>i J cos 2 (/>, -■-' 



Finally, from (21), (23), (25), (26), (28) and (29) we obtain 

(30) £o,co(7\) = -^ [h - 1 + o(l)] , as h -► oo, 
and 

(31) ^oo,co(T fe ) = -2 [e' 1 - 4 + o(l)] , as h -► 00. 

And for ft and 7 satisfying (13), we have asymptotic results 
(16) with N = 2. 

Now let us prove the two results we used in the above. 
Result 1: 

Proof: For any on 6 ((i — |)7r, (i + |)"") such that tan on = 
±paii, (0 < p < 1), we have 



sinh 77 



£ 



COS (f>i 



I sin' a,- 1 cos 2 a,- 



s 2 

pa, 



sinh 77 cosh 77 — 77 r— ' ^ — sin ^ cos fa cos 2 1 



cosh 77 



on — sin cti cos oti (1 + 7? 2 a 2 ) 3 / 2 [(1 =p 73) + p 2 a?] 
73 73 



< 

1 

-H 

7T 



0(1) 



sinh 7; 



< 



cosh 77 (sinh 77 cosh 77 — 77) 



(^^"[l+^-ijV] 



3/2 ' 



o(l) 



(l — 77 sinh 77 cosh 



cosh 77 



n) 

O(e-i), 



Thus 

£ 



I sin' on I cos 2 a,- 



< 



E 



from which we obtain 

(25) \S 2 (h)\ = Ao(e-i), as fe • 

/j 2 



Qi-SinOiCOBOj f— ' r „,. n 2 2 1 3 / 2 



OG . 



< 



pdx 



TT J_« (1 +73 2 X 2 ) 3 / 2 7T ./_„. (1 + 77 2 ) 3 / 



(III 



Similarly, 



1 sinh' 77 



sinh 77 cosh 77 — 77 ■f— ' 9. 



T- 



sin 0, J cos 2 0j cosh 77 



du 



= — , as p — > 



9j cos 0j cos 2 0j + cosh 77 



< 



o(l) 



»>1 

e~ ; — (1 — 77 sinh 77 cosh 77) 



cosh 77 



= 0(e"'), 



so 
(26) 



ISsWI 



1 

7 



0(e 2 ), as h —>- 00. 



To handle the double sum in S\(h) and S±(h), we need 
Result 2: Suppose < p < 1, {aj}j>i are all positive 
solutions to the equation tanx = px, and {/?i}i>i are all 
positive solutions to equation tana: = 73a; (tan a; = — px, 
resp.), then 

sin on sin j3j cos 2 on cos 2 j3j 



(l +u 2)3/2 tt 



Result 2: 

Proof: For simplicity let us denote the (?, j)-term in the sum 
by a,i t j(p). As in the last proof, a little computation would 
give us 

Kj'(p)I = Ip(p<*i,PPj) -P 2 , 
where I p (x,y) (0 < 73 < 1) is the function 

I P (x,y) = 



E 



. J {oti — sin oti cos oti) (fij — sin (3j cos f3j) cos 2 a, + cos 2 /3j 
(27) ->0, as 73^0+. 



V / (l + x 2 )(l + j7 2 )(2 + x 2 + j/ 2 )(l + ^)(1 + 1W) • 

Clearly, I p (-, ■) is (uniformly in 73, < p < 1) bounded above 
by the L X (]R 2 ) function B(-, ■), which is defined as 

B(x,y) 



V / (l + x 2 )(l + j7 2 )(2 + x 2 + y 2 ) ' 



We have two steps to finish our proof: 



(a) lim Y^ \ a i,j(p)\ 



Tl Z 



I (x,y)dxdy, 



(b) lim + J2 a id {p)-I {a .^ p)>0} 

1 

~ 2^ 



I {x,y)dxdy. 



Let us start from (a). Given any e > 0, we can find a 
constant M > such that, for JJjvf = {(x,y) : min(x, y) > 
M} and all < p < 1, 

{/p is decreasing in both x and y in i?M 5 
¥7 / Ir m J p( x > 2/)^cfr/ < ^ / / Hm B(x, 2/)dxefo/ < f . 
Because of this, for any < p < 1, the "tail" sum 



53 Kj(p)I < ^2 



min(pQi ,pf3j)'>M-\-p7r 

(32) 



I p (x,y)dxdy < 



3' 



where we define 0^(0) = for all (i, j). 

On the other hand, as p goes to zero, the function I p will 
converge uniformly in [0,M] 2 to Jo- So all the terms |oi,j(p)| 
in the "head" sum are uniformly very close to Io(pa.i,p/3j)-p 2 , 
the sum of which, multiplied by n 2 , is a Riemann sum of the 
function Io(x,y) over the region [0,M] 2 , and will converges 
to the Riemann integral of Jo over [0, M] 2 as p turns to zero. 
In other words, for small p, there exists 



E \ a i,j(p)\ 

max(pQi ,pf3j)<M-\-p7r 

(33) 
By (32) and (33), we have 



M cM 



I (x 1 y)dxdy 



lim Y \ a i,j(p)\ 



1 



I (x,y)dxdy 



< 



< e. 



(34) 



Now let e goes to zero we are done with (a). 

The proof of (b) is similar. Note that the signs of the 
Oi t j(p)'s can be represented by (— l) l+J or (— 1) I+J+ , and in 
each rectangle [2(i— l)p7r, 2ip7r] x [(J— l)pTT,jpw], (i,j > 1), 
either a2i-ij(p) or a>2ij(p) is positive. With the same constant 
M chosen as above, for the sum of all positive aij(p)'s such 
that max(pai,p/3j) < M +pir, we can use the same argument 
as before, to show that for small p, 



Thus (b) is proven because both the tail integral and the tail 
sum are negligible due the way to choose M. ■ 

In the N CUSUMs case with N > 2, the calculation 
is similar: both of the main terms in i?o,oo,...,oo {Th} and 
in -Eoo,oo,...,oo {Th} are the terms with highest degree in 
[sinh 7//(sinh?7cosh?7 — 77)]. With (20) we can get they are 



(36) 



and 



(37) 



N/i 2 



-[h-l + o(e-*)], 



e h + (N - 2)h + (2 - 3N) + o(e"*) 



respectively. 

We can prove that all other terms converge to zero as h 
goes to infinity. 

With a generalization of Result 1 to n dimensional trigono- 
metric sums and integrals for all n > 1, we are able to 
deal with most terms in the expansion of the expectations, 
because those bounded trigonometric sums are multiplied by 
expressions of negative exponential order in h. 

There is only one term (in i?o,oo,...,oo {Th}) which cannot 
be proven to converge to zero in this manner. We need to 
prove the sum involved there, which is (38) at the top of 
the following page, converges to zero as h goes to infinity. 
We can follow the proof of Result 2 to get the result. To be 
more precise, denote p = \, and the term in above sum by 

*> ' I n 1 rnpn i^K^/ii^nol^/ \ n^- '('nil <^ \ n\ ' ( 



a 



, (p), then obviously, \a\ ■ (p)\ < | «^ 7 - Cp) | , that can help 
us to control the "tail" sum 



E 



i«i?(p)i, 



(40) 

min(p4>i ,p9j )> M -\-pn 

where M is chosen as in the proof of Result 2. On the other 
hand, 



(41) 



\a\ N 1 \p)\ = 4 N \p^pO ] )-p\ 



where Ip ' is the function defined in (39). The function Ip ' 
uniformly converges to Iq as p goes to infinity in the domain 
[0,M] 2 , since pr\ — > 1 as p — > 0+. As a result, the "head" 
sum converges to the same double integral as the one in (33) 
or (35), so we are done! 

Finally, by (36) and (37), we can derive asymptotic formula 
(16) with h and 7 satisfying (13). 



2 ' 2 I E a i,j(p) • 1 {a,, 3 (p)>0} 

, max(pai,p/3j )<M-\-p7T 



(35) 



M r M 



JO 



I (x,y)dxdy. 



(38) 



(39) 



sin' <f>i sin 0j cos 2 <f>i cos 2 



E : : 

i >i (<A« — sin0i cos <f>i)(9j — sin9j cos 0j)[(iV — 2)(1 — 4^j) cos 2 ^ cos 2 0j + cos 2 4>i + cos 2 0j] 
p "" V(l + ^ 2 )(1 + V 2 )[(N - 2)(1 - *>V) + 2 + x 2 + y 2 ](l + ^)(1 + *#) 



